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SOME  THEORETICAL  ASPECTS  OF  raE  LOT  PLOT  SAMPLING  INSPSCTIOH  PLAN 


LINCOLN  E.  MOSES 


Introduction. 

Industrial  sampling  plans  for  the  most  part  are  of  one  of  t»c  types.. 

1.  Attributes  ..plans:  Here  a sample  is  taken  and  each  item  in  the 

sample  is  adjudged  defective  or  nondefective. (for  example,  is  a 
rivet  long  enough,  or  will  a bolt  pass  throvigh  this  hole  but  not 
pass  through  this  smaller  hole?)  If  sufficiently  few  items  in  the 
sample  are  defective,  the  lot  is  accepted  since  the  evidence  in- 
dicates a small  proportion  of  defective  items  in  the  lot. 

2..  Variables  plans;  Here  a sample  is  taken  and  each  item  in  the  sample 
is  measured.  (The  question  is,  "How  long  is  this  rivet?,"  rather 
than  "Is  it  long  enough?")  From  the  mean  of  the  observations 
and  some  measure  of  product  variability,  such  as  the  sample  stand- 
ard deviation,  or  range,  or  a known  value  of  the  true  process 
standard  deviation,  a decision  is  made  as  to  the  fraction  of 
defective  items  in  the  lot.  Making  this  decision  involves  the 
assumption  that  the  distribution  of  measurement  in  the  lot  is 
normal. 

Variables  plans  ordinarily  require  many  fewer  observations  than  attri- 
butes plans  because  they  exploit  the  information  about  the  shape  of  the 
distribution.  On  the  other  hand  if  the  distribution  is  net  normal  this  may 
vitiate  the  decisions  reached  from  a variables  plan;  whereas,  the  decisions 
reached  from  an  attributes  plan  are  in  no  way  disturbed. 


i r ■ 
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Both  types  of  sampling  plans  may  be  regarded  as  alternatives  to  100% 
inspection.  IVhere  it  is  imperative  to  assure  a very  small  fraction  defective 
remaining  in  accepted  lots,  100%  inspection  may  be  used.  However,  much 
experience  indicates  that  100%  inspection  is  often  less  than  100%  effective 
- that  defective  items,  though  inspected,  may  not  be  identified  and  re- 
moved. Since  this  sort  of  condition  arises  largely  from  monotony  and  in- 
spector fatigue,  it  is  often  felt  that  for  large  lots  a good  sampling  plan 
is  a better  recourse  than  100%  inspection,  in  addition  100%  inspection  is 
ordinarily  much  more  expensive  than  sampling  inspection. 

During  recent  years  there  has  been  wi.despread  use  of  a third  sort  of 
substitute  for  100%  inspection,  ’'fhis  is  the  Lot  Plot  Flan,  developed 
Dorian  Shainin,  which  is  a soirt.  of  modified  variables  plan.  It  has  a novel 
feature  howeverj  it  is  intended  to  have  the  advantages  of  a variables  plan 
without  being  sensitive  to  non-normality.  In  striving  to  achieve  this  ob- 
jective, much  reliance  is  placed  on  the  appearance  of  the  sample  histogram 
(the  sample  consists  of  50  items).  The  Lot  Plot  Plan  is  specifically  pro- 
posed as  a method  for  assuring  smaller  fraction  defective  in  accepted  lots, 
than  can  be  achieved  by  100%  inspection  - or  even  multiple  100%  inspection 

LloJ. 
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It  is  the  purpose  of  this  paper  to  consider  theoretical  aspects  of 
the  Lot  Plct  procedure.  The  reader  is  also  referred  to  a paper  by  C.  C. 
Craig  [3J. 

Brief  Description  of  Plan. 

The  inspector  draws  a random  sample  of  50  items  from  the  lot.  Ke 
records  the  measurements  in  sets  of  five,  at  the  same  time  plotting  them 
pn  a conveniently  arranged  specially  prepared  form,  ’^en  all  50  have  been 
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measured  and  recorded  he  has  a histogram  of  from  7 to  16  intervals^ 

(which  facilitates  quick  calculation  of  x)  and  the  data  themselves  recorded 
in  consecutive  sets  of  five  (which  facilitates  the  calculation  of  r^  - the 
average  of  the  ranges  of  the  10  subsamples).  At  this  stage  the  inspector 
has  three  things; 

1.  The  histogram  (the  Lot  Plot)  on  which  are  shown  the  specification 
li.mits . 


2.  X,  the  sample  mean 

3.  r,  the  average  range. 

How  the  statistics  are  used  in  reaching  a decision  depends  upon  how 
the  histogram  looks.  The  histogram  may  appear  to  be  one  of  several  types 
listed  by  Shainin: 

a.  Normal 

b.  Ckewed 

c.  Multimodal 

d.  One  sided  (for  concentricity  pareillelism,  etc.) 

e.  Flat  topped 

f.  Peaked 

g.  Truncated 

h.  With  strays 

If  the  histogram  looks  normal  then  the  "lot  limits"  are  calculated  as 

ULL  “ x-1.3? 

LLL  * x-1.3? 

and  the  lot  is  accepted  if  both  lot  limits  lie  inside  specification  limits. 


V 


After  the  first  five  observations  have  been  drawn  the  inspector  applies  a 
rule  of  thumb  given  him  in  order  to  decide  whether  the  interval  of 
measurement  is  too  coarse  or  too  fine  to  result  in  such  a mmber  of  in- 
tervals for  the  histogram. 


«*  % ' 


If  a lot  limit  lies  beyond  a specification  limit,  then  the  fraction  of  the 
lot  lying  beyond  that  limit  is  estimated  (using  a oonvenient  chart)  from 
the  normal  distribution,  taking  x for  the  meaui  and  r for  2.326(5^  After 
the  fraction  defective  is  estimated  and  entered  on  the  lot  plot,  the  entire 
sheet  is  sent  to  a Salvage  Review  Board  who  decides  disposition.^ 

If  instead  of  looking  normal  the  histogram  looks  skewed,  the  inspector 
calculates  the  two  lot  limits  differently.  He  considers  the  mode  as  the 
origin  and  computes the  root-mean-square  average  of  the  observations 
greater  than  the  mode  (including  half  of  the  frequency  at  the  modal  cell) 
and  sets  the  upper  lot  limit  at  mode  3<5“yj  similarly  he  constructs  the 

/Sk 

lower  limit  at  mode-3(7%  where  root-mean-square  a\rerage  of  the 

observations  below  the  modal  cell,  (including  half  of  the  frequency  at  the 
modal  cell).  If  both  lot  limits  lie  within  the  specification  limits  the 
lot  is  accepted.  Otherwise,  the  proportion  defective  at  each  specification 
is  estimated  as  before,  but  taking  the  mode  for  the  mean  and  the  appropriate 

^ A' 

one  of  or  for  the  standard  deviation. 

If  instead  of  looking  normal  the  histogram  looks  multimodal,  the  in- 
spector calculates  the  lot  limits  still  differently.  In  this  case  he 
considers  the  two  "outboard  modes"  and  if  there  are  sufficient  cases 
beyond  them  he  calculates  separately  a (j^  at  the  upper  one  and  a 
at  the  lower  one  and  sets; 

ULL  = largest  mode+3S^n 


LLL  = smallest  mode-3  0"^ 

If  there  are  only  a few  cases  lying  beyond  either  or  both  of  the 

^ It  is  to  be  observed  that  in  some  plants  the  sample  standard  deviation, 
s,  is  calculated  and  used  for  an  estimate  of  the  process  standard  de- 
viation. In  this  case  the  lot  limits  are  x±3s.  [1] 
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outboard  modes,  he  first  draws  some  additional  observations  and  then  com- 
putes the  lot  limits.  If  one  of  the  lot  limits  lies  beyond  a specification 
limit  the  percent  defective  there  is  estimated  by  taking  the  relevant  one 

/N  A. 

of  (yy  and  0~j^  and  the  appropriate  mode  as  the  standard  deviation  and  mean, 
respectively,  of  a normal  distribution. 

The  other  cases  listed  above  carry  specific  instructions  but  will 
not  be  sketched  here  because: 

1.  They  are  cases  which  arise  less  frequently  in  practice  than 
the  three  above  [4]. 

2.  Description  of  these  cases  is  not  essential  to  an  exposition  of 
the  evaluative  work  being  reported  on  here. 

The  following  remarks  are  in  order  at  this  point 

1.  If  sample  items  lie  outside  the  lot  limits,  the  lot  is  not 
regarded  as  "normal",  but  either  as  "long  tailed"  or  as  "with 
strays . " 

2.  If  a histogram  looks  normal  and  lies  well  within  the  specification 
limits,  the  inspector  may  accept  without  caluc\ilating  any 
statistics  at  all. 

3-  The  inspector  never  rejects  a lot.  He  refers  it  (via  the 
executed  Lot  Plot  form)  to  the  Salvage  Review  Boan-d  (often 
interdepartmental  in  composition).  This  board  weighs  the  evi- 
dence in  the  Lot  Plot  form  and  economic  considerations  such  as 
production  line  needs,  existing  inventdriss,  disassembly  costs, 
etc.,  in  arriving  at  a disposition  such  as  screen,  ret’am  to 
vendor,  accept,  scrap,  remove  some  good  items  and  rework  others. 


4.  The  apparent  vagueness  in  such  phrases  as  "looks  normal'"  is  a 


x'eal  and  genuine  vagueness  in  the  plan  as  published.  In  general,  objective 
criteria  ^except  for  (l)  above)  are  not  given.  It  is  thus  entirely 
possible  for  two  inspectors  to  arrive  at  different  dispositions  of  the 
same  lot  from  the  same  sample. 

Nature  of  a Full  Evaluation  of  the  Plan. 

It  has  already  been  said  that  the  plan  is  intended  to  be  applicable 
regardless  of  the  distribution  of  the  lot.  That  is,  for  any  kind  of  lot 

- or  at  least  for  any  kind  of  lot  which  might  "reasonably"  arise  in  industry 

- the  plan  is  intended  to  give  the  (essentially)  same  tight  operating 
characteristic . 

In  evaluating  the  plan  it  is  thus  necessary  to  consider  how  it  works 
where  the  lot  may  have  any  one  of  various  sorts  of  distributions.  Since 
only  a sample  is  inspected,  a lot  which  is  actually,  say,  skewed  will 
sometimes  give  a histogram  which  appears  to  be  normal,  sometimes  skewed, 
sometimes  flat-topped,  sometimes  bimodal,  etc.  Then  after  a certain  type 
of  analysis  is  decided  upon  (from  looking  at  the  histogram)  the  sample 
may  give  lot  limits  leading  to  acceptance,  or  it  may  notj  auid  the 
probability  of  acceptance  presioraably  should  be  different  for  the  same 
lot  depending  on  what  form  of  analysis  is  used. 

Thus,  if  f • • ^^ ) is  “ given  distribution  type  with  parameters 

, , a full  evaluation  for  this  distribution  type  would 
require  determining.- 

p^(o<JA3^,A2,...A  j^).  Tne  probability  that  the  histogram  would 
"look  like  one  of  typeO(.". 

Lf  ( A 1^  ••  probability  of  acceptance  (as  a function 

of  the  parameters),  given  that  the  histogram  looked  like  one  of 

type*K- 


i 

I 
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It  wo’old  then  be  possible  to  obtain  the  overall  probability  of  acceptance 
for  the  distribution  type  f (as  a function  of  the  parameters)  by  the 
equation , 

Lj ( A/V  2 • • • k = X -f  1»  ^ ^ Pf  ‘*^1^  1 > ^2’  • • * ’ 

when  the  sununation  is  overall  lot  plot  "types." 

There  would  then  remain  the  question,  "Is  Aj^)  actually 

only  a function  of  p,  the  fraction  defective?"  If  so,  it  could  be 
written  as  L^(p). 

If  this  sort  of  investigation  were  then  done  for  many  different  dis- 
tribution ty]:es,  a very  complete  account  of  the  plan's  properties  under 
the  circumstances  for  which  it  was  designed  would  be  obtained. 

Carrying  through  such  a complete  study  is  at  best  horrific  in 
principle.  In  this  case  it  is  also  actually  impossible  because  of  the 
fact  that  the  plan  gives  no  objective  criteria  for  concluding  that  a lot 
plot  "looks  skew",  etc. 

Necessarily  then  this  paper  will  give  a more  modest  evaluation  than 
a complete  analysis  woxild  provide. 


••  ^ 

r 
^ i 


A Counter  Example. 

The  Lot  Plot  Plan  cannot  achieve  the  objective  of  giving  a tight  0.  C. 
for  every  distribution.  In  fact  it  is  easy  to  show  that  for  certain 
kinds  of  distributions  it  must  behave  almost  exactly  like  an  attribute 
plan  calling  for  50  observations  and  rejection  if  one  or  more  defective 
items  are  found.  Consider  a lot  with  the  following  composition:  it 

contains  N items  whose  distribution  is  centered  hal.f  way  between  the  two 
specifications,  the  standard  deviation  is  so  smeill  that  the  distance 
between  the  specification  limits  is  many  standard  deviations  (such  as  10 
or  20),  and  its  shape  is  as  nearly  normal  as  is  possible  for  a discrete 


rwtiTrifcWiitnnrriitVf^'ir^  — v.w---'*  • 
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distribution;  in  addition  it  contains  k "mavericks"  - items  which  are 
outside  the  speciiication  limits  in  any  way  whatever.  Now  consider  the 
operating  characteristic.  Vyhenever  the  sample  of  50  items  includes  none 
of  the  k mavericks,  the  lot  I'lot  will  lead  to  acceptance.  Wlienever  the 
sample  contains  one  or  more  of  the  k items  the  Lot  Plot  will  say  "refer 
to  salvage".  The  plan  will  thus  behave  exact3y  like  the  attributes 
acceptance  plan  mentioned  above. 

A stronger  statement  can  be  made.  It  is  impossible  to  construct 
any  plan,  using  50  observations,  which  has  both  of  the  following  pro- 
perties ; 

a.  There  exist  lots  of  such  high  quality  that  the  plan  is  nearly 
sure  to  accept  them. 

b.  The  plan  is  materially  tighter  than  a 50-observation  attribute 
plan  for  eveiy  kind  of  lot  distribution. 

A formal  statement  and  proof  is  as  follows; 

Any  acceptance  plan  which  requires  n observations  and  has  the 
property  that  for  every  N >n  and  every  € > 0 there  exist  lots 
(of  "high  quality")  such  that  the  probability  of  acceptance, 
exceeds  l-€,  also  has  the  property  that  for  any  given  p there 
exist  lots  vfith  fraction  defective  greater  than  p for  which 
Ap  > - £ wnere  A^  is  the  probability  of  acceptance  using  an 

attribute  plan  with  sample  size  n and  acceptance  number  zero. 

Proof: 

Let  L be  a lot  of  size  N such  that  A (L)  > l-€. 

P 

Consider  the  lot  L’(K)  formed  by  adding  K defectives  to  L 
where  K is  chosen  to  ensure  > p' 


( — 
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Then 


A_(L')  i>  Prob  ) Sample  consists  only  of  items  t 
^ / from  L and  is  accepted 

“ Prob^n  observations  from  Lj  Ap(L) 

i»(^(l-fc)  >fS)  -Ex  a,CL')-€ 


("S“) 


The  nature  of  the  coimter  example  deserves  some  consideration 
from  the  practical  point  of  view.  It  svirely  indicates  that  where  a 
small  fraction  of  strays  constitute?  a serious  problem,  the  Lot  Plot 
Plan  cannot  afford  good  protection.  On  the  other  hand  it  leaves  open 
the  question  how  should  it  behave  in  situations  where  wc  have  normality, 
or  where  the  nonnormality  is  not  a matter  of  strays? 


Tile  Use  of  a 50  Observation  Histogram  to  Detect  Nonnormality. 

The  most  aistinctive  feature  of  the  plan  is  the  use  of  the  histogram 
to  warn  the  user  when  the  normality  assumption  is  invalid  and  to  cause 
him  to  employ  special  techniques,  ilixis  it  is  natural  to  enquire  as  to  the 
efficacy  of  the  plan  in  this  respect. 

Craig  [3J  reports  the  results  of  some  sanqpling  experiments  in  which  he 
forcefully  raises  the  question  what  can  one  learn  about  tne  shape  of  a 
distribution  from  a histogram  based  on  50  observaiio:is?  Other  sampling 
experiments  have  been  done  £4J  again  casting  severe  doubt  on  the 
possibility  of  greatly  profiting  from  a 50-observation  histogram.  Here 
a more  theoretical  view  will  be  taken. 

Because  the  Plan  is  very  vague  as  to  what  sorts  of  loL  plots  are  to 
be  regarded  as  skew,  what  sorts  as  normal,  what  sorts  as  bimodal,  etc., 
it  is  hardly  possible  to  answer  the  question  "How  reliably  will  the  Plan 
protect  against  nonnormality?"  insteaa  we  will  ask  how  well  can  any 
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pTOcedurs  using  i>0  obseiwations  in  groupea  frequencies  identify  ncn-normality? 

Since  it  is  the  aim  of  the  Plan  to  give  protection  against  any  kind 
of  departure  from  non-normality  it  is  fair  to  focus  our  attention  on 
"omnibus"  or  "shotgun"  tests.  We  know  of  one  such  test,  whose  power  we 
can  compute,  and  which  has  the  encouraging  property  of  being  a likelihood 
ratio  test  (for  grouped  frequencies  against  the  class  of  all  alternatives). 
This  test  is  the^Pi  ^ test.  Accordingly  we  computed  the  power  of  the 
test  aga3.nst  various  non-nornal  alternatives.  See  Figures  I,  II,  III,  IV. 

This  was  done  in  the  following  way.  The  null  hypothesis  specified  a unit 
normal  distribution;  the  cells  for  the  test  were  those  given  by  the 
deciles  of  the  i^nit  normal  (this  should  give  a more  sensitive  10-cell  test 
than  equal  length  cells  according  to  results  of  I!ann  and  Wald  [6]). 

Under  the  null  hypothesis  the  expected  cell  frequencies  are  all  5.  For 
various  competing  distributions  having  mean  zero  and  unit  variance  the 
cell  expectations  were  evaluated.  From  these  the  power  of  the  10-cell 

test  could  be  evaluated  using  methods  given  by  Patnaik  [7J.  The 
results  are  sho?m  in  table  1. 

Another  approach  to  the  problem  was  also  taken.  The  same  competitors 

and  cell  intervals  were  'xsed  but  the  test  was  allowed  in  each  case  to  be 

tailor  made  for  maximum  power  against  the  alternative.  This  is  accomplished 

by  using  the  Neyman-Pe arson  criterion  for  testing  a simple  Igrpothesis  against 

a simple  alternative.  The  hypothesis  is  that  the  chosen  intervals  have 

the  probabilities  w specified  by  the  normal  distribution;  the  alternative 

( 

is  that  the  chosen  intervals  have  the  probabilities  specified  by  the 

particular  alternative  distribution.  The  Neyman-Fearson  criterion  then 
gives  the  optimum  test  of  the  hypothesis  against  the  alternative;  optimum 


1 

I 


in  the  sense  that  no  more  sensitive  test  can  possibly  be  constructed. 
Let  the  observed  frequencies  be 

n^  i»l,...10. 

The  Neyman-Pearson  test  is  to  reject  for  sufficiently  small  values  of 


10  /.  \^i  10  . ^ 

Tlfe  ■ 


^i 

Or  if  we  define  w.*  log  -y  we  reject  for  sufficiently  large  values  of 

P ^ 

10 

21  Vi 


Since  the  n^  have  a symmetric  miiltinomial  distribution  under  the  null 
hypothesis  we  should  expect  the  distribution  of  the  weighted  sum  to 
be  fairly  well  approximated  by  the  normal  distribution  with 
mean  = 50i.w^p^ 

2 2 
variance  ® 50^w^  - 50GE-W^p^) 

Thus  the  test  with  significance  level  OC  becomes , Reject  if: 
i»l 

when  we  define  by: 


Under  the  alternative  hypothesis,  ^ 


the  statistic  Z-  n.w.  will  have 
i»l  ^ ^ 


^ The  power  of  this  test  for  any  given  significance  level  would  necessarily 
exceed  that  of  the  Lot  Plot  test  of  normality  if  the  Lot  Plot  used  the 
same  choice  of  cell  intervals. 


I 

L._. 
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mean 


502Iw.  and 


1*^1 


variance  •=  - 50(2"  p^w^)  ' 

again  using  a normal  approximation,  the  power  of  the  test  which  is; 

P^Wi„i  > 5 Z „ . . y?  (2 

may  be  approximated  as : 


p|z  > 


y 5orp;w.=-5o(rpi-,)" 


vdiere  z has  a unit  normal  distribution. 

The  power  of  this  test  against  the  same  alternative  distributions  is 
shown  in  table  2.  Admittedly  study  of  the  values  in  tables  1 and  2 

N 

does  not  tell  us  directly  how  the  Lot  Plot  "test  of  normality"  will  be- 
have for  these  distributions.  However,  both  of  the  tests  considered  do 
enjoy  certain  optimum  properties,  and  there  is  every  reason  to  suppose 
that  the  combination  of  an  inspector  and  a Lot  Plot  diagram  will  3rield  a 
test  of  normality  less  sensitive  than  the  second  of  these  aind  probably 
less  sensitive  than  either.  If  this  be  granted  then,  from  a study  of 
either  table  1 or  2 we  reach  two  conclusions. 

1.  The  Lot  Plot  Plan,  relying  co  a 5C-obssrvation  histogram  to 
identify  non-normality,  cannot  be  rolied  upon  to  protect  from 
distributions  as  nearly  normal  as  these. 

2.  Distributions  as  nearly  normal,  as  these  will  very  often  be  re- 
garded as  normal,  and  it  is  worthwhile  to  see  what  sorts  of 
decisions  will  be  made  when  the  normal  analysis  is  applied  to  them. 


( 


I 

I 
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Effects  of  using  the  "Normal  AnaQjrsis." 


A . General  remarks . 


We  nov/  concern  ourselves  with  examining  the  results  of  an  acceptance 
procedure  which  accepts  if  both 


x+3f2  andx-3^2 

lie  between  the  specification  limits,  and  which  otherwise  rejects.  Since 
the  Lot  Plot  is  sometinies  used  with  the  sample  standard  deviation  rather 
r/ 

than  'd2  for  the  estimate  of  the  problem  will  also  be  investigated 
for  that  case.  The  behaviour  of  these  procedures  will  be  examined  for  the 
normal  distribution  and  a few  members  of  four  types  of  non-normal  distri- 
butions (which  first  appeared  in  the  last  section).  These  four  types  all 
share  the  property  that  the  normal  distribution  is  a limiting  case.  As  the 
parameter  in  either  the  t orP  distribution  increases,  the  shape  of  the 
distribution  increasingly  resembles  the  normal;  similarly,  as  the  two 
parameters  of  the  symmetric  Beta  distribution  increase  it  goes  to  the 

normal.  Finally,  as  the  parameters  ^1  and  /^2  zero  in  the  niixed 

2 2 

normal  with  = C 2 , the  distribution  tends  to  the  normal.  In 

addition,  all  of  these  distributions  except  for  the  extreme  mixed  normal 
are  "bell-shaped",  and  all  of  them  except  for  the  Gamma  distributions 
are  symmetric.  We  have  already  seen  that  if  indeed  the  distribution  of 
the  lot  is  one  of  these  types  there  is  a great  probability  that  it  will 
be  subjected  to  the  normal  analysis. 

In  a certain  sense  ^ it  can  be  said  t.hat  the  plan  "aims"  oo  accept 


If  X * 3s  be  used,  as  the  sample  size  becomes  large  the  probability 
tends  to  one  that  the  lot  will  be  accepted  or  rejected  as  ^ i'iO" 
both  lie  (strictly)  within  the  specification  or  one  at  least  lies 
(strictly)  outside. 


t 
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if  the  points  yU.+  3(7" and  3(5’ both  lie  within  the  specifications,  and 
otherwise  to  reject.  Now  it  is  clear  that  "3-sigraa"  criteria  mean  very- 
different  things  for  different  di.stributions.  Table  3 displays  the 
probability  lying  beyond^^+  3(5’ and  - 3iT’  for  each  of  several  non-norim\l 
distributions.  From  perxisal  of  these  values  we  wo'old  gijess  that  as 
x^s  or  were  successful  in  approximating -3 ff"  , so  also  would 

lots  of  identical  qx:iallty  tend  to  be  accepted  with  widely  different  pro- 
babilities, depending  upon  the  shape  of  the  distribution. 

b.  The  case  of  normally  distributed  product . 

'(Vhere  the  product  is  normally  distrib'ated  the  joint  distribution 
of  X,  s is  of.  course  exactly  known  and  numerical  integration  enables  ':he 
probability  of  acceptance  to  be  evaluated  for  any  relation  oH-M  and 
to  the  specification  limits  *4.  and  L,  As  is  well  known  [lij,  the  probability 
depends  not  only  on  p,  the  fraction  defective,  but  on  how  the  fraction 
defective  is  divided;  if  ^2  lies  beyond  each  specification,  then  the 
probability  of  acceptance  is  greater  than  if  all  of  it  lies  beyond  one 
specification.  (Variables  plans  exist  for  which  the  O.C  . effectively 
depends  on  p alone  [2,9Jj  the  Lot  Plot  Plan  is  inferior  to  them  in  this 
regard).  Figure  V shows  the  O.C.  as  a function  of  p for  various  relations 
of  to  the  specification  limits.. 

If  X and  r be  used,  then  the  exact  distribution  of  r is  not  available. 
However,  an  approximation  due  to  Patnaik  [8]  is  known  to  be  excellent. 
Further  x and  r are  independently  distributed  in  the  normal  case.  Thus 
the  O.C.  can  be  obtained  by  numerical  integration. 

In  either  of  the  above  cases  another  method  of  approximately  evaluating 
the  0X5.  is  available.  We  know  that  x is  exactly  normally  distributed;  r, 
being  the  average  of  ten  indepiendent  ranges,  may  be  considered  approximately 
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normally  distributed,  and  the  sample  standard  deviation  is  asymptoticalljr 
normally  distributed.  Thus  we  maj'  consider  taking  x+3s  and  ji-3s  to  have 
a bivariate  normal  distribution-  Similarly  we  may  consider  taking  x±1.3? 
to  have  a bivariate  normal  distribution.  Table  4 shows  the  values  of  p 
for  which  the  probability  of  acceptance  (from  normal  lots)  equals  .95> 

.90,  .10,  .05  as  calculated  from  the  bivariate  normal  approximation,  and 
by  the  exact  method  for  s,  by  Patnaik's  approximation  for  r.  The  agreement 
is  seen  to  be  good. 

c . t'ethods  used  for  case  of  non-norr.ial  distidbutions. 

When  product  is  not  noraally  distributed  the  exact  distributions 
of  X,  s and  r are  all  unknown  for  the  distributions  considered  here.  This 
means  that  either  approximation  to  these  distributions  or  empirical 
sampling  must  be  used  to  evaluate  the  probability  that  the  lot  limits 
(using  either  s or  r)  will  lie  inside  the  specification  limits.  Hie 
course  chosen  in  this  investigation  was  to  take  the  lot  limits  as  having 
bivariate  normal  distribution.  It  has  already  been  seen  that  this  approxi- 
ation  is  excellent  for  the  normal,  and  it  can  fairly  be  hoped  that  it 
will  not  lead  to  grossly  misleading  results  for  these  distributions  which 
are  "nearly"  normal. 

To  apply  the  bivariate  normal  approximation  it  is  necessary  to  obtain 

its  parameters.  The  mean  and  variance  of  x are  of  c ours eXf  and  when 

2 

andO”  are  the  mean  and  variance  respectively  of  the  distribution 
postulated  for  the  lot.  The  mean  and  variance  of  r^,  the  range  of  five 
observations, were  obtained  by  numerical  evaluation  on  the  CPC  of  the 
integral  expressions  (given  in  (5,  P-233J)  which  are  respectively: 


I 


E(rJ  = \ [l-(l-F(u))5-(F(u))5jdu 


= / |^[F(u)  - 


F(v)]-^  - CL  -F(v)j^  - [F(u)]''  + ifdudv 


In  these  expressions  F(u)  Is  the  cimitilative  distribution  evaluated  at  u. 
r r 

Values  of  E(  and  -^)  for  distributions  are  given  in  table  5-  It 

CT  O r 


is  interesting  to  observe  how  stable  is  the  ratio 


E( 


frc«i  distribution 


to  distribution. 

In  the  case  of  S3T7imetric  distributions  the  correlation  between  the 
range  and  the  sample  mean  is  zero  since  they  are,  after  translation,  even 
and  odd  functions,  respectively.  For  the  Gamma  distributions  the  co- 
variance  between  the  mean  and  range  of  five  observations  was  obtained  by 
numerical  evaluation  of  the  following  integral  expression: 


E(x^r^) 


2^P*^plp! 


- (60p+72)  ( F(x)(l-F(x))xf^c 


when  the  Gamma  density  and  cumulative  function  are,  respectively: 


f(x)  = 

F(x)  = ^ y e’^t^c 


In  terms  of  these  parameters  of  the  joint  distribution  of  x_„  and  r_,  the 

pu  P 

bivariate  normal  approximation  to  the  joint  distribution  of  the  lot 
limits  is  to  take: 


^50 


1.3r,  - ^ - 1.3E(rJ 


. 2.6  f-  V 

^ covCx^r^) 


i 
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X - 1.37c  -A*  1.3E{r  ) 


M ' ^• 


as  having  a bivariate  normal  distribution  vdth  means  zero,  variances  one, 
and  correlation  coefficient: 


r/ 

t 


i-x. 


m 


e 


2 

^ - 1.69 
50  10 


uv 


4U  the  expressions  under  the  square  root  signs  sLmplify  somewhat  for  the 
symmetric  distributions. 

A similar  approximation  was  applied  to  the  problem  when  the  lot  limits  are 
taken  as  x+3s  and  x-3s.  Application  of  standard  methods  [5,  ch,9j  yields 
the  following  results: 

E(x)  = M, 

= 


E(s)  = 0"(1- 


r ^ "^3 

cov(x,s)  = ^ 


var  X 


vai‘  s 


C -<?'2 


■/N 


^4-cr 


4(n-l)Cf" 

In  terms  of  these  parameters  (approxiaiate  in  the  cases  involving  s)  the 
bivariate  normal  approximation  to  the  joint  distribution  of  the  lot  limits 
is  to  take: 

...  _ ^50  -4-  3«r(i  ♦ 


4005* 


J 


■ -sf  .,2 


50 


Mu-  cr^  . ^M3 


(49)cr 


50fi- 


• »w-*  X • « 


■ i'iAu* 


I 


and 
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^ ^50  - ) 

/ XL^  ^ 2 Aj-<s!!  - 

\ 50  4 49<^-^-  50  cT 


as  having  a bivariate  normal  distribution  with  means  zero  and  variances  one, 
and  correlation  coefficient : 


^ u'v’ 


2 

C 

- _2_ 

50 

4.49 

<r>- 

4 -3-(- 

/[50 

4.49  V 

/ J L ^ 

0^ 

Again  there  is  simplification  for  the  qrmmetric  distributions  since  the 
third  central  moment,  A.  is  then  zero. 


I 5 


L 


d.  Results  for  non-normal  distributions. 

The  distribution  theory  whose  development  has  just  been  sketched, 
enables  one  to  evaluate  the  probability  that  the  lot  limits  will  lie 
between  any  given  lower  and  upper  specification  limits,  L and  U respectively. 
Since  for  any  given  distribution  the  fraction  defective  p is  defined  as  the 
probability  lying  outside  the  interval  L to  U we  can  find  both  the  value  of 
p and  the  probability  of  acceptance  associated  with  any  pair  of  specification 
limits. 

In  the  normal  case  it  was  pointed  out  that  the  probability  of  acceptance 
is  not  a function  of  p alone,  but  also  of  how  p,  that  fraction  defective,  is 
divided  between  the  two  ends  of  the  distribution.  In  general  we  should 
expect  this  condition  to  obtain  for  other  distributions  as  well.  Tnerefore, 
in  the  case  of  each  of  the  symmetric  non-normal  distributions  taken  as 
illustrative  examples  in  this  study  two  of  the  infinitely  many  divisions 
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of  r were  considered:  equal  division  of  p between  the  two  ends,  and  all  at 

one  end.  In  the  case  of  the  non-sycunetric  distributions  there  were  three 
cases  investigated:  equal  division  of  p,  all  at  the  left  end,  all  at  the 

right  end. 

Table  6 presents  the  results  obtained.  The  values  of  p leading  to 
probability  of  acceptance  (if  the  "normal  analysis"  is  always  used; 
equal  .9  Juid  .1  are  shown  there  for  several  distributions,  for  symmetric 
and  one-sided  division  of  p,  and  for  both  "range"  and  "standard  deviation" 
lot  limits. 

Study  of  the  figures  in  this  table  indicates  several  things: 

Use  of  range  or  standard  deviation  leads  to  nearly  identical 
results. 

The  plan  is  extremely  "tight"  for  the  normal  distribution. 

The  plan  is  far  tighter  for  some  others  of  these  distributions  (for 
example  the  B(3t 3 ) distribution  lies  entirely  between  U and  L (p=0) 
and  still  the  probability  of  acceptance  is  less  than  .1), 

The  plan  is  very  much  less  tight  for  some  distributions  (such  as  the 
t or  the  P with  all  the  fraction  defective  in  the  upper  tail). 

Skewness  results  in  a violently  strong  dependence  of  L(p)  upon  the  division 
of  the  fraction  defective  between  the  tails. 

In  considering  the  probability  that  the  lot  limits  lie  between  the 
specification  limits  as  a function  of  £ we  find  a great  diversity,  even 
restricting  ourselves  to  the  synmetric  distributions.  Instead  we  may 
examine  the  probability  that  the  lot  limits  lie  between  the  specification 


That  is,  the  probability  that  the  lot  limits  lie  between  U and  L. 
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limits  as  a function  of  how  wide  apart  they  are  (in  tei-ms  of  the  lot 
standard  deviation).  This  is  done  in  table  Here  we  see  a rather 
surprising  degree  of  uniformity.  AH  these  O.C. *s  could  easily  be  plotted 
on  the  same  chart;  in  fact  their  50%  points  all  lie  betwee  .95 


1.00 


60“ 

U-L* 


This  observation  together  with  a remark  made  much  earlier  helps  to  make 
sense  of  the  behavior  of  the  plan.  We  have  just  seen  that  the  probability 
of  obtaining  lot  limi.ts  between  the  specification  limits  depends  upon  the 
distance  bet’.veen  the  specification  limits  in  much  the  same  way  for 
a1 1 these  "nearly  normal"  distributions.  On  the  other  hand,  we  earlier 
saw  that>U  *3  0“  limits  have  greatly  different  values  of  p associated  with 
them.  From  these  two  facts  we  coiild  predict  what  was  shown  in  table  6, 
that  the  behavior  of  the  plan  in  terms  of  the  proportion  defective  depends 
strongly  upon  the  type  of  distribution. 


e.  Estimation. 

iVhen  the  Lot  Plot  looks  normal,  but  the  lot  limits  do  not  both  lie 
between  the  specification  limits  the  lot  is  referred  to  salvage  with  an 
estimate  of  the  fi*action  defective  beyond  each  limit.  These  extimates  are: 


where ^Tis  either  s or  ^/62, 

The  question  naturally  arises,  what  properties  have  these  estimates? 

The  answer  would  seem  to  be  that  for  distributions,  such  as  the  t,  with 
much  probability  in  the  tails,  the  estimates  above  will  tend  to  be  under- 
estimates, and  for  distributions  with  little  in  the  tails  (such  as  the  Beta) 
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the  estimates  will  tend  to  be  overestimates.  For  example  we  see  from 
table  6 that  if  the  distribution  of  product  is  B(3,3)  with  actually  zero 


fraction  defective  we  may  still  accept  with  probability  less  than  ,lj 
the  case  shown  in  the  table  is  for  the  specification  limits  at  the  ends 
of  the  (finite)  range  of  i.he  distribution.  In  such  a case  v/henever  we 
reject  we  estimate  some  positive  value  for  or  for  , of  for  both; 
whenever  the  lot  is  accepted  the  estimate  for  both  is  zero.  Clearly* 
the  expected  value  of  zero,  the  actual  fracti  .-n  defective. 

Similar  reasoning  confirms  the  statement  made  for  long  tailed  distributions 
such  as  the  t.  The  simple  fact  woxild  seem  to  be  that  though  one  can 
estimate  )Lj  andCT' with  fair  success  for  many  distributions,  since  identical 
pairs  of  values  for  and  <T  denote  greatiy  different  probabilities  in  the 
tails  for  different  distributions,  we  cannot  heps  to  estimate  these 
probabilities  with  uniform  success  by  always  pretending  the  distribution 
is  normal. 


Non  Normal  analysis; 

Although,  as  we  have  seen,  for  non-norm^il  distributions  of  our  illus- 
trative types  the  "normal  cuaalysis"  will  often  - cr  indeed,  usually  - be 
used,  it  is  profitable  to  investigate  what  vdll  be  the  effects  of  another 
type  of  analysis  when  used. 

In  all,  about  11  different  sorts  of  analysis  are  distinguished  in  the 
plan.  Only  two  of  these,  besides  the  normal  analysis,  receive  attention 
in  this  study.  These  are  the  "sketf";ind  multimodal  cases.  Since  the  special 
procedures  in  both  these  cases  depend  upon  the  mode  it  is  very  difficult 
to  make  any  study  of  sample  behavior;  little  if  anything  is  known  about  the 
sampling  distribution  of  the  mode.  However,  we  can  again  "look  at  the 
problem  in  the  parameters.  ••  If  the  inspector  knew  the  lot  was  skewed(or 
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niultijiiodal)  knew  the  mode(s),  and  knew  the  tnae  valiies  oi'  (T~  and  , 

U Li 

then  how  would  lots  of  various  quality  fare  under  the  riile(s)  which  set 
the  lot  limits  at 

mode  - 26'^  and  mode  3(Tu 

for  skewed  lots,  or 

•smallest  mode  and  largest  mode  ♦ 2(J“^ 

for  multimodal  lots?  Table  8 shows  that  the  rule  - ^ the  parameters 
were  known  would  lead  to  very  different  results  depending  upon  what  distri- 
bution, or  which  end  of  the  distribution,  is  being  considered. 

It  can  certainly  be  said  that  there  are  grounds  for  doubting  that  the 
special  rules  for  these  two  cases,  at  least,  vrill  go  far  toward  making 
the  operating  characteristics  of  the  plan  independent  of  the  distribution 
of  the  lot. 

Summary  and  discussion. 

The  results  can  be  summarized  as  follows : 

1.  Tne  lot  plot  plan  fails  - as  must  any  iiO-observation  plan  - in 

its  objective  of  being  uniformly  tight  regardless  of  lot  distri- 
bution. ' 

2.  The  observation  histogram  will  usually  judge  to  be  normal 

lots  which  in  fact  have  fraction  in  their  tails  appreciably  larger, 
or  appreciably  smaller  than  has  the  noi-mal. 

3.  The  probability  that  lot  limits  will  lie  between  the  specification 
limits  depends  upon  the  distance  (in  standard  deviation  vuiit-s) 
between  the  specification  limits  in  a way  which  is  not  strongly 
dependent  upon  the  lot  distributionj  but  (almost  as  a result) 

the  probability  of  acceptance  depends  very  differently  upon  the 


fraction  defective  for  different  distributions.  (That  vailue  of  the 

fraction  defective  for  which  the  probability  of  acceptance  is  .9 

varies  for  cases  considered  between  0 (for  3(3.3))  and  .006  (for  L_) 

5 

fractions  defective  with  10^  probability  of  acceptance  range  from 
0 (for  3(3,3))  to  .045  (for  attributes  plan  n=50  c=0). 

4.  The  procedures  for  estimating  fraction  defective  will  lead  to  s^/s- 
teraatic  overestimates  for  some  distributions,  systematic  under- 
Cistimates  for  others. 

5.  The  procedure  for  dealing  vdth  non-normal  distribution  are  question- 
able 

Since  many  of  these  conclusions  apply  entirely  or  in  soir.e  degree  to  any 
variables  plan  it  is  fair  to  ask  how  does  the  lot  plot  i Ian  comrare  with 
other  variables  plans? 

It  is  clear  that  when  ail  lots  are  normal,  existing  plans  are  superior 
for  several  reasons.  The  lot  plot  procedure  will  unfort\inately  from  time 
to  time  lead  to  treating  a sampie  as  coming  from  some  other  kind  of  distri- 
bution - say  biraodal;  existing  variables  plans  will  routinely  treat  all 
samples  by  those  methods  which  are  for  the  normal  distribution  the  optimiim 
ones.  Further,,  plans  which  give  one  probability  of  acceptance  for  each 
fraction  defective  regardless  of  how  it  is  divided  between  the  tv/o  ends  of 
the  distribution  are  preferable  on  tliose  grounds  alone. 

If  lots  are  not  normal  then  either  lot  plot  or  other  existing  variables 
plans  may  behave  in  strange  ways,  vfnen  the  user  requires  "iron-clad  pro- 
tection" regardless  of  the  lot  distribution  an  attributes  plan  is  needed. 

Finally,  tliere  is  a great  inflexibility  in  approaching  every  acceptance 
sampling  problem  with  the  same  decision  procedure  - "Take  50  observations 
at  random,  and....  Different  problems  may  legitimately  call  for  different 
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procedures.  This  option  is  not  a part  of  LJis  Lot  Plot  Plan  as  it  is  of 
Mil  Standard  105a,  or  NavOrd  80  or  other  standard  plans  which  give  choice 
of  AQL  and  sample  size. 

Despite  the  various  shortcomings  of  the  plan  which  have  received 
emphasis  here,  it  has  xindoubtedly  been  successful  in  many  installations. 
What  features  of  the  plan  may  have  contributed  to  its  success?  There  is 
no  doubt  that  the  plan  has  a very  definite  psychological  appeal  arising 
from  literally  "seeing  a picture"  of  the  sample.  The  provision  for  always 
taking  the  same  size  s.ample  is  administratively  (and  psychologically)  con- 
venient, however  inadequate  it  may  be  from  some  points  of  view. 

Tf  lots  are  usually  nonaal  and  the  user  actually  needs  a very  tight 
plan  it  is  not  a bad  approximation  to  existing  good  unVuiown  stai'idard  devi- 
ation plans,  and  the  usual  benefits  of  ’.cell  chosen  variables  plans  will 
largely  accrue  to  the  Lot  Plot  user  \jnder  these  circuriistances . In  cases 
of  gross  br'jnodality,  for  example,  the  luiutogram  will  give  definitely  useful 
information  about  the  process  which  generated  the  lot. 

Finally,  the  provision  that  though  an  inspector  may  accept  the  lot 
it  requires  the  salvage  review  board  to  dispose  of  one  in  any  other  way 
should  have  important  administrative  advantages  in  many  settings : economic 
factors  will  tend  to  be  systematically  weighed  at  the  time  of  disposition 
of  the  lotj  if  the  salvage  review  board  contains  representation  from  the 
departments  which  (in  addition  to  inspection)  are  concerned,  then,  fewer 
dispositions  of  lots  should  result  in  difficulties  such  as  production 
flow  problems . 
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